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SPECIFICATION 



RATE N/N SYSTEMATIC, RECURSIVE CONVOLUTIONAL ENCODER AND 



1 . Field of the Invention 

This invention generally relates to convolutional encoders, and, more 
specifically, to rate n/n systematic, recursive convolutional encoders for use in serial 
concatenated coding and serial concatenated trellis coded modulation. 

10 2. Background 

Serial concatenated convolutional codes (SCCC) offer the potential of 
significant coding gains at low bit error rates (BER) compared to conventional coding 
schemes. SCCC are the topic of several recent patents or publications including U.S. 
Patent Number 6,023,783; "Turbo Codes: Analysis, Design, Iterative Decoding and 

15 Applications," Course 909, Part II, Intemational Courses for Telecom and 

Semiconductor Professionals, S. Benedetto & D. Divsalar, October 25-29, 1999, 
Barcelona, Spain (hereinafter "Divsalar 1"); "A Serial Concatenation Approach to 
Iterative Demodulation and Decoding," K. Narayanan et al., IEEE Transactions on 
Communications, Vol. 47, No. 7, July 1999; "'Turbo DPSK': Iterative Differential 

20 PSK Demodulation and Channel Decoding," P. Hoeher et al., IEEE Transactions on 
Communications, Vol. 47, No. 6, June 1999; "Serial and Hybrid Concatenated Codes 
with AppUcations," D. Divsalar et al., Proc. Int. Symp. Turbo Codes and Appls., 
Brest, France, Sept. 1997, pp. 80-87 (hereinafter "Divsalar 2"); "Turbo Trellis Coded 
Modulation With Iterative Decoding for Mobile Satellite Communications," D. 

25 Divsalar et al., Proc. Int. Mobile Satellite Conf , June 1997 (hereinafter "Diysalar 3"); 
"Serial Concatenated Trellis Coded Modulation with Iterative Decoding: Design and 
Performance," submitted to IEEE Comm. Theory Mini Conference 97 (Globecom 
97); "Near Shannon Limit Error-Correcting Coding: Turbo Codes," C. Berrou et al., 
Proc. 1993 IEEE Intemational Conference on Communications, Geneva, Switzerland, 

30 pp. 1064-1070, May 1993; "A Soft-hiput Soft-Output Maximum A Posteriori (MAP) 
Module to Decode Parallel and Serial Concatenated Codes," S. Benedetto, TDA 



CORRESPONDING DECODER 



BACKGROUND OF THE EWENTION 
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Progress Report 42-127, November 12, 1996. Each of these references is hereby 
fully incorporated by reference herein as though set forth in full. 

A rate (2b+l)/(2b+2) convolutional encoder, where b is an integer, is proposed 
in Divsalar 2 and 3 for the inner encoder in a serial concatenated trellis coded 
5 modulation (SCTCM) encoder. The problem is that such an encoder is complex and 
difficult implement. 

In Narayanan et al., a rate 1 differential encoder is proposed for the inner 
encoder of a SCTCM encoder. Two successive encoded bits are mapped into symbols 
using 71/4-DQPSK modulation. The rate 1 differential encoder of Narayanan is 
10 illustrated in Figure 1 A. Input bits are provided as an input to adder 2 over signal line 
1. The output 5 of storage element 3 is also provided as an input to adder 2. The sum 
from the adder 2 is stored in storage element 3. 

The rate 1 encoder, while simpler than the rate (2b+l)/(2b+2) encoder of 
Divsalar, has a problem in that the parallel output of the encoder at a particular point 
1 5 in time is capable of supporting only BPSK or QPSK modulation. Higher order 

modulation schemes either are not supported, or can be supported only by considering 
successive outputs of the encoder in a differential mode of operation. 



recursive, systematic convolutional encoder. The encoder has n inputs, n parallel 
outputs, an adder having (n+1) inputs and an output, n being an integer greater than 1, 
and a feedback loop, including one or more storage elements in series, from the output 
of the adder to an input thereof The feedback loop and the one or more storage 
25 elements may be characterized by a prime polynomial. In addition, all n encoder 

inputs are input to the adder, (n-1) of the encoder inputs are passed through unaltered 
to form (n-1) of the encoder outputs, and the nth encoder output is derived from the 
feedback loop. 



30 having n+1 inputs and an output, n being an integer greater than 1, a storage element 
having an input coupled to the output of the adder and an output coupled to an input 
of the adder, wherein all n encoder inputs are input to the adder, (n-1) of the encoder 



SUMMARY OF THE INVENTION 



20 



In accordance with one aspect of the invention, there is provided a rate n/n 



In one implementation, the encoder comprises n inputs, n outputs, an adder 



2 



Howrey Dk^o. 01827.0037.US00 
Conexant Re^^e No. 00CXT0357D 



inputs are passed through unaltered to form (n-1) of the encoder outputs, and the nth 
encoder output is derived from the output of the storage element. 

Li one application, the rate n/n encoder forms an inner encoder of a SCTCM 
encoder in which the inner encoder is coupled in series with a bit to symbol mapper in 
5 which the order of mapping is a higher order than BPSK. In one implementation 

example, the bit to symbol mapper is a Gray mapper. The bit to symbol mapper may 
also be a multi-dimensional mapper in which case the mapper is followed by a 
multiplexor for serializing the multiple coordinates of each symbol. 

A method in accordance with the subject invention comprises the steps of 
10 inputting n bits to a rate n/n systematic, recursive convolutional encoder configured in 
accordance with the invention, wherein n is an integer greater than 1 ; receiving in 
parallel from the encoder the resultant n output bits; and mapping the n output bits 
into a D-dimensional channel symbol, wherein D is an integer of 1 or more, the order 
of mapping being greater than BPSK. In one implementation, applicable in the case 
15 in which D is greater than 1 , the method further comprises the step of serializing the 
D components of the channel symbol, 2 at a time. 

Another aspect of the invention is a related decoder configured to decode the 
encoded symbols as produced by the encoder of the invention. The decoder may be a 
Viterbi decoder, a SOVA decoder, or a MAP decoder. 

20 

DESCRIPTION OF THE DRAWINGS 
Figure 1 A illustrates a conventional rate 1 encoder. 
Figure IB illustrates a SCCC encoder. 
Figure IC illustrates an iterative SCCC decoder. 
25 Figure 2 illustrates a plot of bit error rate (BER) vs. Eb/No which is 

characteristic of SCCC. 

Figure 3 A illustrates a first embodiment of a rate 3/3 encoder in accordance 
with the subject invention. 

Figure 3B illustrates a second embodiment of a rate 3/3 encoder in accordance 
30 with the subject invention. 

Figure 4 illustrates an embodiment of a rate 2/2 encoder in accordance with 
the subject invention. 
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Figure 5 illustrates an embodiment of a rate 4/4 encoder in accordance with 
the subject invention. 

Figure 6 illustrates a SCTCM encoding system in which the inner encoder 
thereof is an encoder in accordance with the subject invention. 

Figures 7A-7B illustrate one embodiment of the combination of a rate 3/3 
encoder and an 8-PSK symbol mapper in accordance with the subject invention. 

Figures 8A-8B illustrate one embodiment of the combination of rate 6/6 
encoder and a four-dimensional 8-PSK symbol mapper in accordance with the subject 
invention. 

Figures 9A-9B illustrate one embodiment of the combination of a rate 4/4 
encoder and a 16-QAM symbol mapper in accordance with the subject invention. 

Figure 10 illustrates one embodiment of a method in accordance with the 
subject invention. 

Figure 1 1 A illustrates an embodiment of a rate n/n systematic, recursive 
convolutional encoder configured in accordance with the subject invention. 

Figure IIB illustrates an implementation of a rate n/n systematic, recursive 
convolutional encoder configured in accordance with the subject invention. 

Figure 12A illustrates a comparison of the performance of a rate Va 8-PSK 
SCTCM encoder with, respectively, a rate 3/3, a rate 6/6, and a rate 5/6 inner encoder. 

Figure 12B illustrates a comparison of the performance of a rate 5/6 8-PSK 
SCTCM encoder with, respectively, a rate 3/3, a rate 6/6 inner, and a "best-d2" (JPL) 
rate 3/3 encoder. 

Figure 12C illustrates a comparison of the performance of a rate 8/9 8-PSK 
SCTCM encoder with, respectively, a rate 3/3 and a rate 6/6 inner encoder. 

Figure 12D illustrates a comparison of the performance of a rate 4/5 QPSK 
SCTCM encoder with, respectively, a rate 2/2 and a rate 4/4 inner encoder. 

Figure 13A illustrates a comparison of the performance of a rate 2/3 SCTCM 
encoder with, respectively, a JPL "best distance" rate 5/6, a rate 3/3, a rate 6/6, and a 
JPL "best d2" rate 5/6 inner encoder. 

Figure 13B illustrates a comparison of the performance of a rate 5/6 SCTCM 
encoder with, respectively, a rate 3/3 and a rate 3/3 ("best d2") inner encoder. 

Figure 13C illustrates a comparison of the performance of a rate 5/6 8-PSK 
SCTCM encoder with, respectively, a rate 3/3 and a rate 6/6 inner encoder. 
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Figure 13D illustrates a comparison of the performance of a rate 8/9 8-PSK 
SCTCM encoder with, respectively, a rate 3/3 and a rate 6/6 inner encoder. 

Figure 14 is a block diagram of a decoder configured for use with the encoder 
of the subject invention. 



Figure 16 is an embodiment of a decoding process employed by a SISO in the 
decoder of Figure 14. 

Figure 17 is an embodiment of an overall decoding process employed by the 
decoder of Figure 14. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
A. Example Environments 

In a SCCC encoder, illustrated in Figure IB, an outer encoder 7 is coupled in 
series with an interleaver 8, which in tum is coupled to an iimer encoder 9. Typically, 
15 each of the outer and inner encoders 7 and 9 are convolutional encoders. Input bits 
are input to outer encoder 7 over signal line 6. Encoded bits output from the outer 
encoder 7 are interleaved by interleaver 8. The interleaved bits are input to inner 
encoder 9. Inner encoder 9 encodes the interleaved bits and outputs the encoded bits 
on signal line 10. 

20 A SCCC decoder, illustrated in Figure IC, is typically iterative. An inner 

decoder 12 is coupled in series with de-interleaver 13 which in tum is coupled in 
series with outer decoder 14. A feedback loop is provided between an output of outer 
decoder 14 and an input of inner decoder 12. Included in the feedback loop is 
interleaver 16. After transmission over a channel, incoming bits are input to inner 

25 decoder 12 over signal line 1 1 . A priori information is provided to the inner decoder 
12 from interleaver 16 over signal line 17. After a prescribed number of iterations, 
the decoded bits are output by the outer decoder on signal line 18. 

Serial concatenated trellis coded modulation (SCTCM) is a technology related 
to SCCC. An encoder for SCTCM is similar to that for SCCC, except that, in the 

30 SCTCM encoder, a bit to symbol mapper is coupled in series with inner encoder 9, 
and the output of the encoder thus consists of encoded channel symbols rather than 
bits. Similarly, a decoder for SCTCM is similar to that for SCCC except that, in the 
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Figure 15 is an example of a trellis diagram. 
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SCTCM decoder, encoded symbols after transmission over a channel are input to the 
inner decoder 12 rather than encoded bits. 
B. Embodiments of Invention 

An embodiment of a rate n/n encoder in accordance with the subject invention 
5 is illustrated in Figure 11 A. As illustrated, the encoder comprises n inputs 55, n 
outputs 60, an adder 58 having n+1 inputs and an output, wherein n is an integer 
greater than 1, and a feedback loop 59 coupled between the output of the adder and 
one of the inputs thereof, the feedback loop including one or more storage elements 
61a, 61b, 61c coupled in series, wherein the feedback loop is characterized by a prime 

10 polynomial, (n-1) of the encoder inputs, identified in the figure with numeral 57, are 
systematic inputs. That means they are passed through the encoder to form (n-1) of 
the encoder outputs, identified with numeral 60. The nth encoder output, identified 
with numeral 62, is derived from the feedback loop 59. All n inputs 55 of the encoder 
are input to the adder 58. The (n+l)th input to the adder is the output 62 of the 

1 5 encoder. 

The adder may logically add the (n+1) inputs thereof, or equivalently, 
logically subtract one or more of the inputs, since logical addition and subtraction 
have the same result with 2's complement arithmetic and single bit operands. For 
purposes of this invention, the term "adder" is meant to encompass both modes of 
20 operation. 

The polynomial characterizing the feedback loop in Figure 1 1 A can be 
expressed as follows: ho+ (hi x X) + • • • + (hr-i x X*^"^) + (hr x X*^), in which ho=hr=l 
and hi, where 0 < i < r, can be either 0 or 1, depending on the state of modules 63b, 
63c. For example, in the case in which r=3, and module 63c i such that hi=l, and 

25 module 63b is such that h2=0, the polynomial characterizing the feedback loop can be 
expressed as X^+X+1. 

One implementation of a rate n/n encoder configured in accordance with the 
subject invention is illustrated in Figure 1 IB in which, compared to Figure 11 A, like 
elements are referenced with like identifying numerals. 

30 In this implementation, the feedback loop coupled between the output of the 

adder and the input thereof includes a single storage element 61 configured as shown. 
The polynomial which characterizes this feedback loop is (1+X), which is a prime 
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polynomial. The constraint length, which equals the number of storage elements plus 
1, is equal to 2. The nth output of the encoder, identified with numeral 62, is the 
output of storage element 61. 

There are several aspects of this encoder which make it well-suited for 
5 functioning as the inner encoder in a SCTCM or SCCC encoder. 

The first is that a single bit error at the input of the encoder will typically 
magnify itself, and result in many bit errors in the output of the encoder. This can be 
seen most directly from Figure 1 IB. Assume all input bits should be 0 and that, at a 
time t, one of the input bits is perturbed by noise and is a 1. The output 62 of the 
10 storage element will remain a 1 until another one of the input bits is perturbed by 
noise and is switched to a 1 . This is a desirable attribute for an inner encoder in a 
SCTCM or SCCC encoder because it makes it more likely that the erroneous bit 
Gl would be detected by the decoder. 

^ The second is that, because its rate is 1, it allows more redundancy to be 

4j 15 shifted to the outer encoder. This is a desirable attribute because it results in a 

G lowering of the bit error rate (BER) in the floor portion of the BER vs. Eb/No curve for 

the SCTCM or SCCC encoder. This is explained more fully in the following 
0^ paragraphs. 

yj An example of an Eb/No curve for a SCTCM encoder is illustrated in Figure 2. 

S 20 The curve has a waterfall region, identified with numeral 19, and a floor region, 

identified with numeral 20. Typically, the SCTCM encoder is operated at a point on 

the floor region 20. 

. (^^)| 

The BER of the floor region is related to N ^ ^ \ where N is the interleaver 
length, and dfree is the free distance of the outer encoder. Therefore, by shifting 

25 redundancy to the outer encoder, which has the effect of increasing dfree, the BER for 
the floor region can be shifted lower. For example, consider a SCTCM encoder with 
a desired rate of 2/3. For a rate 5/6 inner encoder, a rate 4/5 outer encoder is required. 
At the rate, a BER of 10'^ to 10'^ is possible. However, for a rate 1 inner encoder, a 
rate 2/3 outer encoder can be used. That results in a BER of 10"* * to 10'^^, which is a 

30 significant difference. 

The third is that the related decoder is less complex and simpler to implement 
than the rate (2b+l)/(2b+2) decoder associated with the encoder disclosed in Divsalar 
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1, 2, and 3 (the collective teachings of which are hereinafter referred to as 
"Divsalar"). 

A first embodiment of a rate 3/3 encoder in accordance with the subject 
invention is illustrated in Figure 3A. As shown, this encoder comprises 3 inputs, 
5 identified with numeral 21, and 3 outputs, identified with numeral 22. Each of the 3 
inputs 21a, 21b, 21c is input to adder 24. Li addition, two of the inputs, 21a and 21b, 
are systematic inputs and are passed directly through the encoder to form outputs 22a 
and 22b. The output of the adder 24 is coupled to storage device 25. The output of 
storage device 25 forms output 22c. In addition, the output of storage device 25 

10 forms an input to adder 24. 

A second embodiment of a rate 3/3 encoder in accordance with the subject 
invention is illustrated in Figure 3B. As shown, this encoder comprises 3 inputs, 
identified with numeral 27, and 3 outputs, identified with numeral 30. Each of the 3 
inputs 27a, 27b, 27c is input to adder 28. In addition, two of the inputs, 27a and 27b, 

15 are systematic inputs and are passed directly through the encoder to form outputs 30a 
and 30b. The output of the adder 28 forms output 30c. In addition, the output of 
adder 28 is forms the input to storage device 31. The output of storage device 31 
forms an input to adder 28. Compared to the embodiment of Figure 3B, the 
embodiment of Figure 3 A is preferred because it will have slightly better distance 

20 properties, although both are advantageous in relation to the prior art. 

An embodiment of a rate 2/2 encoder in accordance with the subject invention 
is illustrated in Figure 4. As shown, the encoder has 2 inputs, identified with numeral 
34, and 2 outputs, identified with numeral 35. Each of the two inputs 34a, 34b is 
input to adder 36. In addition, one of the inputs, 34a, is a systematic input and is 

25 passed directly through the encoder to form output 35a. The output of adder 36 forms 
the input to storage device 37. The output of storage device 37 forms output 35b. In 
addition, the output of storage device 37 forms an input to adder 36. 

An embodiment of a rate 4/4 encoder in accordance with the subject invention 
is illustrated in Figure 5. As shown, this encoder comprises 4 inputs, identified with 

30 numeral 39, and 4 outputs, identified with numeral 40. Each of the 4 inputs 39a, 39b, 
39c is input to adder 63. In addition, three of the inputs, 39a, 39b, 39c are systematic 
inputs and are passed directly through the encoder to form outputs 40a, 40b, 40c. The 
output of the adder 63 is coupled to storage element 42. The output of storage 



Howrey Dl 
Conexant Rei 




'O.01827.0037.US00 
ke No. 00CXT0357D 



5 



10 



=y4 

nJ 15 



25 



30 



element 42 forms output 40d. In addition, the output of storage element 42 forms an 
input to adder 63. 

Alternative versions of the embodiments of Figures 4 and 5 are also possible 
in which the output of the adder forms an output of the encoder. These variants are 
logical extensions of the embodiment illustrated in Figure 3B, and need not be 
discussed further. 

The rate n/n encoder of the subject invention may comprise or form part of an 
inner encoder of a SCCC or SCTCM encoder. Figure 6 illustrates an inner encoder 
for a SCTCM encoder which incorporates the rate n/n encoder of the subject 
invention. As illustrated, the inner encoder comprises a serial to parallel (S/P) 
converter 44, a rate n/n encoder 45 configured in accordance with the subject 
invention, a bit to symbol mapper 46, and, optionally, a symbol multiplexor 47. 
Licoming bits (such as from interleaver 8 in Figure IB) 48 are serially input to S/P 
converter 44. S/P converter 44 converts the serial stream of input bits to successive 
parallel renditions of n bits each. Each n bit rendition 50 is input to a rate n/n encoder 
45 configured in accordance with the subject invention. The output of the rate n/n 
encoder comprises successive parallel renditions of n bits each. Each n bit rendition 
51 is input to bit to symbol mapper 46. Bit to symbol mapper 46 converts each 
rendition 51 of n bits to a D-dimensional channel symbol, where D is an integer equal 
to 1 or more. In the case in which n=D=l, the symbol multiplexor 47 is unnecessary. 
In the cases in which n D or n=D>l, the symbol multiplexor 47 serialize the D 
components of a D-dimensional symbol and outputs the same on signal line 49. In 
one implementation, the multiplexor serializes the D components 2 at a time to 
represent the I and Q components of a quadrature output. 

Figures 7-9 illustrate various embodiments of a combination of a rate n/n 
encoder in accordance with the subject invention and a bit to symbol mapper. Figure 
7 A illustrates an embodiment of a rate 3/3 encoder in accordance with the subject 
invention in which a 3-tuple of input bits is represented by (U2, ui, uq), and a 3-tuple of 
output bits by (y2, yi, yo). Figure 7B illustrates the functioning of the bit to symbol 
mapper which, in this particular example, maps each 3-tuple (y2, yi, yo) output from 
the encoder into an 8-PSK symbol. The particular mapping which is used can be 
represented by the following table: 
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3-tuple (y2, yi, yo) 


8-PSK symbol 


(0, 0, 0) 


71/16 


(0, 0, 1) 


371/16 


(0, 1, 1) 


571/16 


(0, 1, 0) 


771/16 


(1,1,0) 


971/16 


(1,1,1) 


ll7t/16 


(1,0, 1) 


137t/16 


(1, 0, 0) 


157t/16 



As can be seen, in this particular example, a Gray mapping is employed, in which 
adjacent symbols correspond to 3-tuples which differ by no more than a single bit. 

Figure 8 A illustrates an embodiment of a rate 6/6 encoder in accordance with 
5 the subject invention in which a 6-tuple of input bits is represented by (us, U4, U3, U2, 
Ui, uo). The encoder is configured to be used in combination with a 4-dimensional bit 
to symbol mapper is which the 6 output bits form two 3-tuples, represented 
respectively as {yi, y/, yo^) and as {yi, yi^, yo^), and each such 3-tuple is mapped 
into an 8-PSK symbol. Figure 8B illustrates the functioning of this bit to symbol 
10 mapper. The particular mapping which is used can be represented by the following 



table: 



3-tuple iyi, y\\ yo'), i=0,l 


8-PSK symbol 


(0, 0. 0) 


71/16 


(0, 0, 1) 


371/16 


(0, 1, 1) 


571/16 


(0, 1, 0) 


771/16 


(1, 1,0) 


971/16 


(1,1,1) 


ll7t/16 


(1,0, 1) 


137t/16 


(1,0,0) 


1571/16 
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As can be seen, in this particular example, a Gray mapping is employed, in which 
adjacent symbols correspond to 3-tuples which differ by no more than a single bit. 
An alternate Gray mapping is also possible with 8-PSK since, as is known, there are 
two unique Gray maps for 8-PSK. 

Figure 9A illustrates an embodiment of a rate 4/4 encoder in accordance with 
the subject invention in which a 4-tuple of input bits is represented by (U3, U2, ui, uo). 
The encoder is configured to be used in combination with a bit to symbol mapper is 
which a 4-tuple of output bits, represented as (ya, y2, yi, yo), is mapped into a 16- 
QAM symbol. Figure 9B illustrates the functioning of this bit to symbol mapper. 
The particular mapping which is used can be represented by the following table: 



4-tuple (y3, y2, yi, yo) 


16-QAM symbol (I,Q) 


(1,1,1,0) 


(-3, +3) 


(1, 1, 0, 0) 


(-l,+3) 


(1,1,0, 1) 


(+1,+1) 


(1,1, 1, 1) 


(+3, +3) 


(0, 1, 1, 1) 


(+3,+l) 


(0,1,0,1) 


(+1,+1) 


(0. 1, 0, 0) 


(-1,+1) 


(0, 1, 1, 0) 


(-3,+l) 


(0, 0, 1,0) 


(-3, -1) 


(0, 0, 0, 0) 


(-1,-1) 


(0. 0, 0, 1) 


(+1, -1) 


(0, 0, 1, 1) 


(+3,-1) 


(1,0, 1, 1) 


(+3, -3) 


(1,0, 0, 1) 


(+1,-3) 


(1,0, 0,0) 


(-1,-3) 


(1,0, 1,0) 


(-3, -3) 



As can be seen, in this particular example, a Gray mapping is employed, in which 
adjacent symbols (in a horizontal or vertical sense) correspond to 4-tuples which 
differ by no more than a single bit. 
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Additional embodiments are possible in which any combination of phase, 
amplitude, and frequency modulation may be employed for the mapping process. For 
example, a rate 2/2 encoder in combination with a QPSK mapper, a rate 4/4 encoder 
in combination with a four-dimensional QPSK mapper, or a rate 6/6 encoder in 
5 combination with a six-dimensional QPSK mapper are all possible. 

Figure 1 1 is a flowchart illustrating an embodiment of a method of operation 
in accordance with the subject invention. In step 52, an n-tuple of bits is input to a 
rate n/n encoder configured in accordance with the subject invention, where n is an 
integer greater than 1. In step 53, an n-tuple of bits is received as an output from the 
10 encoder. In step 54, the n-tuple of output bits is mapped into a D-dimensional 
channel symbol, where D is an integer greater than or equal to 1. In one 
implementation, a Gray mapping is employed in which the tuple of bits corresponding 
to adjacent symbols differ by no more than 1 bit. 



1 5 application, a rate n/n encoder in accordance with the invention is combined with a bit 
to symbol mapper. The combination may form the inner encoder of a SCTCM 
encoder. 

In another application, a rate n/n encoder in accordance with the invention 
forms the inner encoder of a SCCC encoder. 

20 The foregoing SCTCM or SCCC encoders may comprise part of a transmitter 

which in turn may form part of a wireless or satellite transceiver. It may also be in a 
wireline transceiver (e.g., cable modem). The transceiver in turn may form part of a 
wireless device, including a mobile wireless device such as a handset or a wireless or 
satellite link in a vehicle, truck, or automobile, or an immobile device such as a set- 

25 top box coupled to a visual display such as a television or a computer monitor. 

In one application, a transmitter incorporating a SCCC or SCTCM encoder (in 
which the inner encoder is an encoder of the subject invention) is used in conjunction 
with one or more receivers each incorporating a decoder corresponding to the SCCC 
or SCTCM encoder. The transmitter and receivers are coupled by a wireless 

30 interface. The transmitter broadcasts encoded information over the wireless interface 
to the one or more receivers. The receivers decode the information and correct for 
errors introduced through transmission over the wireless interface. 



Several applications of the invention will now be described. In one 
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A block diagram of the decoder is illustrated in Figure 14. As illustrated, two 
instances of a four port device known as a soft input soft output (SISO) module are 
employed in the system. The first such module is inner SISO 115, and the second 
such module is outer SISO 117. 



bit input, and two outputs, a coded (C) bit output, and an uncoded (U) bit output. A 
priori information is provided to either or both inputs of the SISO. Responsive 
thereto, the SISO computes extrinsic a posteriori information. For the inner SISO, 
this extrinsic information is log-likelihood ratios (LLRs) for each of the source bits. 

10 For the outer SISO, this extrinsic information is LLRs for each of the coded symbols. 
After a prescribed number of iterations, the outer SISO provides a posteriori 
information for each of the source bits. The LLRs for the coded symbols are output 
on the C output of the SISO module, and those for the uncoded source bits are output 
on the U output of the SISO module. 

15 With reference to Figure 14, information received over the wireless interface, 

comprising encoded symbols output by a SCCC or SCTCM encoder (in which the 
inner encoder is an encoder of the subject invention) and perturbed by noise through 
transmission over the wireless interface, are input to the coded (C) input of inner 
SISO 115. A priori information is provided to the U input of inner SISO 115 by 

20 interleaver 118. This information originates fi-om the C output of SISO 117. 

The extrinsic U output of the irmer SISO module 115, after passage through 
de-interleaver 116, forms a priori information which becomes the sole input to outer 
SISO 117. This a priori information is input to the C input of outer SISO 117, the U 
input of which is not used. 

25 The inner SISO 115 corresponds to, and in some sense is intended to decode, 

inner encoder 9 (Figure IB), while the outer SISO 117 corresponds to, and in some 
sense is intended to decode, outer encoder 7 (Figure IB). 

The decoder of Figure 14 is iterative. After a predetermined number of 
iterations, the LLRs provided at the U output of the outer SISO module 1 17 are used 

30 to form the estimates of the unencoded source bits through comparison with a 
predetermined threshold. If the LLR exceeds the threshold, the corresponding 
estimate is set to a logical one; otherwise, the estimate is set to a logical zero. Note 



5 



Each such module has two inputs, a coded (C) bit input, and an uncoded (U) 
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that, prior to the completion of the predetermined number of iterations, the U output 

of the outer SISO 1 17 is unused. 

The process employed by each of the SISOs can be further explained in 

relation to a trellis diagram, an example of which is illustrated in Figure 15. The 
5 horizontal axis of the trellis represents time, while the vertical axis represents the state 

of the corresponding convolutional encoder. The index k is used to refer to time, 

while the index m is used to refer to the state of the corresponding convolutional 

encoder. The branches represent permissible state transitions. A solid branch 

represents a state transition that occurs upon the receipt of an unencoded source bit 
10 which is a logical zero, while a dashed branch represents a state transition that occurs 

upon the receipt of an unencoded source bit which is a logical one. Each branch is 

labeled with the corresponding encoder output. 

As observations, either intrinsic or extrinsic, are received, the SISO 

recursively calculates forward probabilities, that is, probabilities which, at time k, are 
1 5 computed based on the probabilities which are computed at time k-1 . The forward 

probabilities are computed for each of the nodes m. In addition, the SISO recursively 

calculates reverse probabilities, that is, probabilities which, at time k, are computed 

based on the probabilities computed at time k+l. 



20 recursively calculates forward state probabilities for a portion of the trellis in a 

forward sliding window, and one or more backward engines recursively calculate 
backward state probabilities for portions of the trellis in one or more backward sliding 
windows. The backward recursion is performed by calculating probabilities at time k 
based on the probabilities which were computed at time k+1 . The forward recursion 

25 is performed by calculating probabilities at time k based on the probabilities which 
were computed at time k-1. At the point in the trellis where these two processes 
overlap, transition probabilities can be computed. These transition probabilities are 
then used to compute LLRs. 



30 through the trellis, and the one or more backward sliding windows are moved 

backward through the treUis. Eventually, the process results in LLRs being computed 
for each of the times k represented by the trellis. LLRs for both the coded symbols 
and unencoded source bits are computed. These LLRs are refined as the iterations 



A sliding window technique is employed in which a forward engine 



The process continues as the forward sliding window is moved forward 
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progress. When the prescribed number of iterations has been completed, the LLRs 
are used to estimate the unencoded source bits. 

The process is a modified form of the algorithm described in "Optimal 
Decoding of Linear Codes for Minimizing Symbol Error Rate," L.R. Bahl et al., IEEE 
Transactions on Information Theory, March 1974, pp. 27-30 (hereinafter referred to 
as "the Bahl reference"), with the specific modifications thereof being described in 
"Near Shannon Limit Error-Correcting Coding and Decoding: Turbo Codes," C. 
Berrou et al., Proc. ICC '93 Geneva, Switzerland, May 1993, pp. 1064-1070 
(hereinafter referred to as "the Berrou reference"). Both of these references are 
hereby fully incorporated by reference herein as though set forth in full. 

A flowchart of the process is illustrated in Figure 16. Although this flowchart 
generally illustrates the process which is employed by both the inner and outer SISOs, 
there are slight differences in the procedure employed by the two SISOs, which will 
be highlighted in the following discussion. In this flowchart, the notation a k(m), 
yi(Rk,m',m), and (3k(m) are described in the Berrou reference. 

In step 121, the boundary values a o(m) and PN(m) are initialized for all values 

of m. 

In step 122, for each observation Rk, the probabilities a k(m) and yi(Rk,m',m) 
are computed using equations (21) and (23) from the Berrou reference. Note that the 
"observation" Rk which is received differs between the two SISOs. For the inner 
SISO 115, each observation Rk comprises the channel symbols output from inner 
encoder 9, as perturbed by noise through passage through the channel, and also zik, 
the a priori information originating fi-om outer SISO 117, and passed through 
interleaver 118. For the outer SISO 117, each observation Rk comprises Z2k, the a 
priori information originating fi-om outer SISO 117, and passed through interleaver 
118. Through these equations, the probabilities a k(m) are computed recursively as a 
fimction of a'k-i(m). 

In step 123, after the complete sequence Ri^ has been received, the 
probabilities pk(ni) are computed using equation (22) fi-om the Berrou reference. 
Through this equation, the probabilities Pk(m) are computed recursively as a function 
of pk+i(ni). 
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In step 124, the joint probabilities ^ k(ni) are computed y multiplying a'k(ni) 
and Pk(m) as follows: X\(m)= a k(ni)»Pk(m). 

In step 125, the a posteriori probability (APP) that an unencoded source bit, dk, 
is the value i, is computed, both for i=0 and for i=l, using the equation 
APPf =^^^\J = 0,1 . Then, the log-likelihood ratio for the bit dk is computed using 

m 

the following equation: 



m 

After a prescribed number of iterations, this value is then used to form the 
estimate of dk by comparing it to a predetermined threshold. Prior to then, these 
10 values, after passage through de-interleaver 118, form the a priori information which 
is provided to the C input of outer SISO 117. 

Figure 17 illustrates the overall process employed by the system of Figure 14. 
In step 126, within the inner SISO 115, after receipt of a fi-ame of observations Rk, the 
LLRs for each of the unencoded source bits dk are computed. 
15 In step 133, the a priori C input to the inner SISO 1 15 is subtracted fi-om these 

LLRs to form extrinsic information output fi-om the U output of inner SISO 115. 

In step 127, after passage through de-interleaver 16, these values are provided 
as a priori information to the C input of outer SISO 117. Responsive thereto, in step 
128, the outer SISO 117 computes the LLRs for each of the coded bits Cn. 
20 In step 134, the a priori information provided to the C input of outer SISO 117 

is subtracted from these LLRs to provide extrinsic information. 

In step 129, after passage through interleaver 118, these extrinsic values are 
provided as a priori information to the U input of inner SISO 115. 

In decision block 130, it is determined whether additional iterations should be 
25 performed. If so, the process is repeated, beginning with step 126. If not, a jump is 

made to step 131. In step 131, in the outer SISO 117, the LLR for each unencoded bit 
dk is determined, and then, in step 132, the LLRs are compared with a predetermined 
threshold to determine estimates of the vmencoded bits dk. 

The decoder may be any soft output iterative decoder configured to decode 
30 serial concatenated codes in which the outer code is a redundant convolutional code, 
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and the inner coder is a rate n/n systematic recursive convolutional code of the subject 
invention. The decoder may employ, without limitation, the Viterbi algorithm, the 
soft output Viterbi algorithm (SOVA), a maximum a posteriori (MAP) algorithm, or 
the a posteriori probability (APP) algorithm. 



The performance of a SCTCM encoder utilizing as its inner encoder the 
combination of a rate n/n encoder in accordance with the invention and a bit to 
symbol mapper was simulated over a variety of conditions. The parameters varied 
include the overall rate of the SCTCM encoder and the value of n for the rate n/n 
encoder. Li addition, the performance of a SCTCM encoder utilizing as its inner 
encoder the combination of a rate n/n or rate (2b+l)/(2b+2) encoder configured as 
described in Divsalar 1 and 2 with a bit to symbol mapper was also simulated. These 
results allow the performance of different rate n/n encoders to be compared to one 
another; they also allow the performance of the rate n/n encoders of the subject 
invention to be compared to that of the rate n/n and rate (2b+l)/(2b+2) encoders 
described in Divsalar 1, 2, and 3. 

The results are all in the form of BER vs. E\/No plots. The waterfall region of 
these plots was calculated using Monte Carlo simulation; the floor region was 
estimated from a Union (upper) bound derivation. 

Figure 12A illustrates the performance of an overall rate Va SCTCM encoder 
with 8-PSK channel symbol mapping, representing an overall throughput of 2.25 
bits/symbol. Three different inner codes were simulated: (a) a rate 3/3 code in 
accordance with the subject invention; (b) a rate 6/6 code in accordance with the 
subject invention; and (c) a rate 5/6 code. As can be seen, the best performance in the 
BER floor region (where the operating point will be) is achieved with the rate 6/6 
code. The BER floor for this code is about 10'^. Interestingly, the rate 5/6 code only 
achieves a BER floor of about 10'^. 

Figure 12B illustrates the performance of an overall rate 5/6 SCTCM encoder 
with 8-PSK charmel symbol mapping, representing an overall throughput of 2.5 
bits/symbol. Two different inner codes were simulated: (a) a rate 3/3 code in 
accordance with the invention; (b) a rate 6/6 code in accordance with the subject 
invention; (c) a rate 3/3 code in accordance with the teachings of Divsalar. As 



EXAMPLES 
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illustrated, in the BER floor region, the performance of the rate 6/6 code of the 
invention slightly exceeds that of the rate 3/3 code of the invention. For the rate 6/6 
code, the BER floor ranges between 10"^ and 10'^. Note also that v^hile the rate 3/3 
code of Divsalar has a lower BER floor, its waterfall performance is almost 1.5 dB 
5 worse. 

Figure 12C illustrates the performance of an overall rate 8/9 SCTCM encoder 
with 8-PSK channel symbol mapping, representing an overall throughput of 2.67 
bits/symbol. Two different inner codes were simulated: (a) a rate 3/3 code in 
accordance with the subject invention; and (b) a rate 6/6 code in accordance with the 

10 subject invention. As illustrated, in the BER floor region, the performance of the rate 
6/6 code slightly exceeds that of the rate 3/3 code. For the rate 6/6 code, the BER 
floor is slightly above 10'^. 

Figure 12D illustrates the performance of an overall rate 4/5 SCTCM encoder 
with QPSK chaimel symbol mapping, representing an overall throughput of 1.6 

15 bits/symbol. Two different inner codes were simulated: (a) a rate 2/2 code in 

accordance with the subject invention; and (b) a rate 4/4 code in accordance with the 
subject invention. As illustrated, in the BER floor region, the performance of the rate 
4/4 code slightly exceeds that of the rate 2/2 code. For the rate 4/4 code, the BER 
floor is slightly above 10"^. 

20 Figure 13A illustrates the performance of an overall rate 2/3 SCTCM encoder 

with 8-PSK signal mapping, representing an overall throughput of 2 bits/symbol. 
Five different inner codes were simulated: (a) a baseline rate 5/6 code in accordance 
with the teachings of Divsalar; (b) a rate 6/6 code in accordance with the invention; 
(c) a rate 3/3 code in accordance with the invention; and (d) a "best d2" rate 5/6 code 

25 described in Divsalar. Only the performance in the waterfall region was simulated. 
As illustrated, with the exception of the baseline 5/6 code, the best performance is 
achieved with the rate 6/6 code of the subject invention. (NOTE: the reference to 
"m" in the figure refers to the size of the encoder memory, and the reference to 
iterations refers to the number of iterations that is performed in the turbo decoding 

30 process.) 

Figure 13B illustrates the performance of an overall rate 5/6 SCTCM encoder 
with 8-PSK signal mapping, representing an overall throughput of 2.5 bits/symbol. 
Two different inner codes were simulated: (a) a baseline rate 3/3 code in accordance 
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with the invention; and (b) a rate 3/3 code described in Divsalar. Only the 
performance in the waterfall region was simulated. As illustrated, the performance of 
the baseline rate 3/3 code vastly exceeds that of the rate 3/3 code described in 
Divsalar. 

Figure 13C illustrates the performance of an overall rate 5/6 SCTCM encoder 
with 8-PSK signal mapping, representing an overall throughput of 2.5 bits/symbol. 
Two different inner codes were simulated: (a) a rate 3/3 code in accordance with the 
invention; and (b) a rate 6/6 code in accordance with the invention. Only the 
performance in the waterfall region was simulated. As illustrated, the performance of 
the rate 6/6 code exceeds that of the rate 3/3 code. 

Figure 13D illustrates the performance of ctn overall rate 8/9 SCTCM encoder 
with 8-PSK signal mapping, representing an overall throughput of 2.67 bits/symbol. 
Two different inner codes were simulated: (a) a rate 3/3 code in accordance with the 
subject invention; and (b) a rate 6/6 code in accordance with the subject invention. As 
illustrated, the performance of the rate 6/6 code exceeds that of the rate 3/3 code. 

While embodiments, implementations, and implementation examples have 
been shown and described, it should be apparent that there are many more 
embodiments, implementations, and implementation examples that are within the 
scope of the subject invention. Accordingly, the invention is not to be restricted, 
except in light of the appended claims and their equivalents. 
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